IBM GX20-1787-0 Floating Point Hex Evaluation Aid free download

File name GX20-1787-0_Floating_Point_Hex_Evaluation_Aid.pdf

=~ _ System/3S0 = ::-::. ~ ';' ~ Reference Data Direct Evaluation of Floating Debugginq Point Numbers in Hexadecimal Aid The information in this publication is based in part on data contained in Form A22.o821-7. The following tables can be used to evaluate a floating point number represented in hexadecimal form. The technique uses a table lookup in the hexadecimal integer table, and a table lookup in the hexadecimal fraction table. The user unites the integer from the first table with the fraction from the second table, to form one number, and then performs a calculation to obtain the value of the floating point number. ConWln;on EXlIITJple Convert the floating point number BFF13A2C to decimal. 1. Look up the three digits to the right of the two characteristic digits in the direct hexadecimal integer table. BF~A2C 3859 2. Assume there is a hexadecimal point to the right of the digits just looked up. Look up the rightmost three digits in the hexadecimal fraction table, and unite this fraction with the integer from step 1, above. BFF 13~ 3859.6357 3. Perform a desk calculator operation on the result of step 2, the operation being determined by the two leftmost hex digits and the following lists. Two !Two leftmost Divide Multiply eftmost Divide Multiply digits by by ~igits by by 3D ~6,777 ,216 BD -16,777,216 3E 1,048,576 BE -1,048,576 3F 65,536 BF -65,~ 40 4,096 CO -4,096 41 256 C1 -256 42 16 C2 -16 43 1 1 C3 -1 -1 44 1E C4 -16 45 25E C5 -256 46 4,09E C6 -4,096 47 65,53E C7 -65,536 3859.6367 _ -.0688933670 (Answer) -86,536 0 1 J 3 4 5 I 7 8 9 A B C D E F OIL 0000 0001 0001 0003 0004 OOOS oooe 0007 oooe 0009 0010 0011 0012 0013 0014 0015 OL 0011 0017 0018 0019 OO!O 0021 0022 0023 0024 0025 00J8 0027 0028 0029 0030 0031 Ol.. 0032 0033 0034 0035 0031 0037 0038 0039 0040 0041 0042 0043 0044 0045 0046 0047 03_ 0048 0049 OOISO 0051 0052 0053 00S4 0055 0058 0057 0058 0059 0060 0061 0062 0013 OL 0014 OOIIS 0088 0087 0018 0089 00'70